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ABSTRACT. —The Jolly-Seber model is a capture-recapture model that can provide less-biased survival 
and population size estimates than those produced from simple counting procedures. Parameter estimation 
by simple counts and Jolly-Seber methods are based on certain assumptions that directly determine the 
validity of estimates. Evaluation of assumptions for parameter estimation is a focus of this paper and 
used as a basis for determining which methods are more likely to produce better estimates. An example 
of population size and survival estimation for a peregrine falcon ( Falco peregrinus) population in western 
Greenland is used to compare the two methods. Based on results from the Greenland peregrine population, 
and an assessment of the underlying assumptions of simple counts and the Jolly-Seber model, we suggest 
that Jolly-Seber estimation of survival and population size is less biased than simple counts in studies 
with marked birds. We recommend the use of a Jolly-Seber analysis of data when capture-recapture 
techniques are employed in raptor population studies. 
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Sobrevivencia y estimacion del tamano poblacional en estudios de rapaces: una comparacion de dos metodos 

Resumen. —El modelo Jolly-Seber es un modelo de captura-recaptura que puede proveer menor error 
en las estimaciones de sobrevivencia y tamano poblacional que aquellos producidos por procedimientos 
de conteos simples. Parametros de estimacion por simples conteos y por metodos Jolly-Seber estan basados 
en ciertas presunciones que determinan directamente la validez de las estimaciones. La evaluation de 
presunciones para parametros de estimacion es el foco de este articulo y es usado como un base para 
determinar cual metodo probablemente produce las mejores estimaciones. Un ejemplo de estimacion del 
tamano poblacional y de sobrevivencia en una poblacion de Falco peregrinus en West Greenland, se uso 
para comparar ambos metodos. Basados en los resultados de la poblacion de F. peregrinus de Greenland 
y una medida de las presunciones fundamentals de conteos simples y del modelo Jolly-Seber, nosotros 
sugerimos que la estimacion Jolly-Seber de sobrevivencia y tamano poblacional tiene menos error que 
uno de un conteo simple en estudios con aves marcadas. Nosotros recomendamos el uso de un analisis 
Jolly-Seber de datos cuando se usan tecnicas de captura-recaptura en estudio de poblaciones de rapaces. 

[Traduction de Ivan Lazo] 


Historically, biologists have relied on counts of 
unmarked birds or tallies of nests to create an index 
to raptor numbers or to estimate the number of 
breeding raptors in a study area (Hancock 1964, 
King et al. 1972, Whitfield et al. 1974). More re¬ 
cently, biologists have marked birds and resurveyed 
study areas to recapture or resight known individuals 
to estimate turnover, mortality, and population size 
(Mearns and Newton 1984, Newton 1986, Court et 
al. 1989, Lebreton et al. 1992). These estimates can 
be biased due to assumption violations and failure 
to use all available information, consequently lead¬ 


ing to inaccurate results. In this paper, we discuss 
Jolly-Seber estimation (Jolly 1965, Seber 1965) as 
a useful method for obtaining survival estimates and 
population size estimates of raptors based on cap¬ 
ture-recapture data of marked individuals. Recap¬ 
ture is a general term referring to either the actual 
capture of an individually marked bird, as in Mearns 
and Newton (1984), the resighting of individuals 
(Hestbeck et al. 1991), or both (Court et al. 1989) 
The Jolly-Seber model has been described exten¬ 
sively in the literature (Cormack 1973, Seber 1982, 
Pollock et al. 1990) and has been the basis for several 
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computer programs: POPAN-3 (Arnason and 
Schwarz 1987), RELEASE (Burnham et al. 1987), 
JOLLY (Pollock et al. 1990) and SURGE (Lebre- 
ton et al. 1992). Although the Jolly-Seber model has 
been applied in bird studies before (Stokes 1984, 
Spendelow and Nichols 1989, Pollock et al. 1990), 
it has seen limited use in raptor studies (Franklin 
et al. 1990, Noon et al. 1992). Noon et al. (1992) 
used a Jolly-Seber analysis to estimate survival of 
California spotted owls ( Strix occidentalis occiden¬ 
talis), but relied upon simple counts to estimate pop¬ 
ulation size. Franklin et al. (1990) estimated the 
number of northern spotted owls ( Strix occidentalis 
caurina ) with empirical and Jolly-Seber methods. 
The Jolly-Seber estimates were used for density es¬ 
timation, but no clear reason was given for the choice. 

The enumeration method has been compared to 
the Jolly-Seber model (Nichols and Pollock 1983, 
Pollock et al. 1990). Simple counting procedures 
differ from the enumeration method by considering 
only the captures or sightings at a given sampling 
occasion for population size estimation and only con¬ 
secutive sightings for survival estimation. Believing 
that demographic parameter estimates are only as 
valid as the method used to obtain them, we have 
examined the assumptions behind simple counting 
procedures and the Jolly-Seber method. Data from 
peregrine falcon ( Falco peregrinus ) surveys in west¬ 
ern Greenland (Mattox and Seegar 1988, W.S. See- 
gar, M.R. Fuller, W.G. Mattox, W.R. Gould un- 
publ. data) which, henceforth, we refer to as the 
Greenland study, are used to illustrate some differ¬ 
ences among simple counts and estimates from the 
Jolly-Seber analysis. Based on an assessment of the 
underlying assumptions of simple counts and some 
uses of recapture-resighting data, we recommend 
capture-recapture techniques as a more appropriate 
means for evaluating raptor populations and suggest 
a Jolly-Seber analysis of such studies. 

The Jolly-Seber Model 

In many situations, it is not feasible to assume a 
closed population; that is, that no births, deaths, 
emigration, or immigration occur. The Jolly-Seber 
model (Jolly 1965, Seber 1965) is a capture-recap¬ 
ture model allowing for an open population in which 
additions and/or deletions occur. The model pro¬ 
duces estimates (and estimated standard errors) of 
survival (1 — mortality — emigration) and recruit¬ 
ment (births and immigrants) between sample pe¬ 


riods, as well as population size estimates at the 
sampling occasions, given the following assumptions: 

(1) All animals present at the ith sample of the 
population have equal probability of capture (p ,) 
i = 1, . . . , k. 

(2) All animals marked in the ith sample have the 
same conditional probability of surviving from 
time i to time i + 1 (0j i = 1,2,... ,k~ 7. 

(3) Marks are not lost and all are reported. 

(4) All samples are instantaneous and each release 
is made immediately after the sample. 

The survival estimator, 0 L> actually measures the re¬ 
turn rate (1 — mortality — emigration), where the 
effects of mortality and emigration (assumed per¬ 
manent) are not separable. The most general Jolly- 
Seber model allows for survival, recruitment, and 
capture probabilities to vary among sampling oc¬ 
casions. For a detailed description of the Jolly-Seber 
model, see Seber (1982) or Pollock et al. (1990). 

Reduced-parameter versions of the Jolly-Seber 
model have also been proposed (Jolly 1982, Pollock 
et al. 1990) and have been incorporated along with 
the Jolly-Seber estimators in the computer package 
JOLLY (Pollock et al. 1990). The sequence of mod¬ 
els, Model D assuming constant survival and capture 
rates, Model B assuming constant survival, and 
Model A, in which capture and survival rates vary 
over time, form a series of increasingly complex mod¬ 
els. Goodness-of-fit tests (Brownie et al. 1986), which 
utilize individual capture history information and 
tests between models based on a conditional likeli¬ 
hood approach (e.g., Brownie and Robson 1983), 
can be particularly useful to raptor ecologists. Other 
special cases of the Jolly-Seber model, such as a 
death-only model, and generalizations, such as a 
temporary trap response model also are available in 
program JOLLY. The existence of such models al¬ 
lows for tests of assumptions to be made, which can 
serve to further validate the conclusions drawn from 
an analysis. Programs RELEASE and POPAN-3 
contain simulation components that allow the user 
to evaluate the robustness of estimators to assump¬ 
tion violations using simulated survival data. 

In many raptor studies, individual nest sites are 
checked every year (Falk and Moller 1988, Mattox 
and Seegar 1988, Geissler et al. 1990), rather than 
an entire area being surveyed completely and con¬ 
sistently (Mindell et al. 1987). The nest fidelity ex¬ 
hibited by peregrines (Mearns and Newton 1984, 
Court et al. 1989, Seegar et al. unpubl. data) and 
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other raptors results in heterogeneous capture prob¬ 
abilities of the population. Previously marked birds 
are more likely to be resighted (recaptured) in the 
future than unmarked birds. We classify this result 
as heterogeneity rather than trap response because 
this fidelity is a natural characteristic of the birds, 
not a response to capture (i.e., “trap happy”) at these 
sites. Fuller and Mosher (1987) discuss detectability 
in reference to external variables, such as the skill 
of the field personnel, weather, time of year, etc. In 
addition, characteristics of the birds themselves (age, 
sex, etc.) can cause differences in detectability. For¬ 
tunately, Jolly-Seber survival estimates are robust 
to heterogeneous capture probabilities (Carothers 
1973, 1979), particularly in studies with relatively 
high capture probabilities (>0.50; Gilbert 1973). 

Unlike survival estimates, population size esti¬ 
mates are not robust to heterogeneous capture prob¬ 
abilities. Marked birds with higher recapture (re¬ 
sighting) probabilities result in the underestimation 
of the population size. Carothers (1973) and Gilbert 
(1973) simulated the effects of heterogeneity on pop¬ 
ulation size estimates, finding that the negative bias 
of the estimates can be severe. The magnitude of 
bias depends on the average capture probability and 
the degree of variation in capture probabilities among 
individuals (Pollock et al. 1990). 

The second assumption of all marked animals 
having the same conditional probability of survival 
does not equate survival between marked and un¬ 
marked animals. However, in practice, biologists will 
want to make this equality in order that survival 
estimates will refer to the entire population. The 
experience of Mearns and Newton (1984) and that 
in the Greenland study (W.G. Mattox pers. comm.) 
suggests that marking (leg bands) has little or no 
effect on the survival of raptors. Age-specific differ¬ 
ences in survival rates have been investigated by 
Manly (1970) who found survival and population 
size estimates were positively biased when young 
animals have lower survival probabilities than older 
animals. However, Manly (1970) concedes that age- 
specific differences are not of great importance unless 
mortality rates are strongly affected by age. Pollock 
et al. (1990) gives a thorough discussion of an age- 
dependent Jolly-Seber method. The studies dis¬ 
cussed in this paper are of breeding-age birds, thus 
avoiding age-specific differences between adults and 
juveniles. 

Any loss of marks by birds will result in the un¬ 
derestimation of survival rates, because birds that 


lose marks will be identified less often. In this sce¬ 
nario, population size estimates are not affected (Ar- 
nason and Mills 1981), although the precision of the 
estimators does change. Recent studies in which rap¬ 
tors have been double banded (Court et al. 1989, 
W.S. Seegar pers. comm.) provided little or no ev¬ 
idence of band loss. 

The Simple Count of Marked Birds 

Using simple counts, maximum mortality esti¬ 
mates (and thus minimum survival rates) are based 
on tallies of turnover and movement within the study 
area. To estimate turnover, birds must be marked 
for identification and then retrapped or resighted to 
determine whether or not a bird has returned to its 
previous nest site. Turnover estimates (and survival 
estimates) based on simple counts can be incorrect 
when they make an invalid assumption and do not 
use all of the information available for estimation. 
Turnover (p t ) is defined in Mearns and Newton 
(1984:349) as the proportion of territories where 
identified individuals were caught (seen) in succes¬ 
sive years ( n ) that do not contain the same individual 
in the second year (n d ), 

A = njn. 

An estimate of maximum mortality (ra max ) is then 
derived from turnover by accounting for known 
movements (n k ) within the study area, 

ax = (n d - n k )/n. 

By subtracting the known movements, the remaining 
proportion becomes the maximum mortality esti¬ 
mate. Minimum survival (A) is simply, 

A = 1 - hi max • 

The estimate of turnover (as defined above) does not 
include vacancies by birds unless they are replaced 
by another identified bird, meaning that a site oc¬ 
cupied one year and not occupied the next year is 
excluded from the turnover estimate. The implicit 
assumption made by simple counts is that all va¬ 
cancies not replaced by another bird are a result of 
permanent emigration and none are due to the death 
of the birds. In many cases this is known to be untrue 
(marked birds are found dead elsewhere; Yates et 
al. 1988, Seegar et al. unpubl. data). Only when a 
bird is replaced by another identified bird is a va¬ 
cancy considered to be caused by death of the indi¬ 
vidual. We argue that this formulation underesti¬ 
mates mortality, causes the maximum mortality es- 
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timate to be misleading, and uses only part of the 
available data that are useful for estimates. 

The departure of a bird from a nest area in the 
Mearns and Newton (1984) study was always re¬ 
placed by another individual (R. Mearns pers. 
comm.). The maximum mortality estimate derived 
when departures are always replaced by another 
individual is valid for the observed nest sites. How¬ 
ever, in many studies, nest departures are not always 
replaced by other birds (James et al. 1989, Court et 
al. 1989). In these cases, the exclusion of nest-site 
vacancies from the turnover estimate can negatively 
bias the maximum mortality estimate. Court et al. 
(1989) recognized this imperfection in the commonly 
used definition of turnover and included known va¬ 
cancies in their turnover and maximum mortality 
estimate. All prior occupancies can be used in this 
estimate, regardless of replacement by another bird. 
Nevertheless, this approach provides only a value 
for maximum mortality, because it cannot be used 
to account for emigration, or for undetected move¬ 
ment of birds within the study area. 

Population size estimates from simple counts are 
based solely on the number of birds seen or captured 
each year. Birds need not be marked for such cal¬ 
culations. The simple count method with unmarked 
birds effectively assumes detection probabilities of 
one, an invalid assumption in the Greenland study 
and many other cases (Grier 1977, Postovit 1979, 
Bird and Weaver 1988). Hodges et al. (1984) give 
reasons for true capture/resighting probabilities be¬ 
ing less than one, ranging from unfavorable soaring 
conditions to obscured nesting and perching sites. 
Ground surveys are often subject to logistical con¬ 
straints resulting from irregular terrain or impass¬ 
able rivers (Mattox and Seegar 1988) that can cause 
some birds to have very low detection probabilities. 
Places in which nesting was once unknown (Mearns 
and Newton 1984), or was thought not possible can 
be overlooked (Pruett-Jones et al. 1981, MacLaren 
et al. 1984), only to find the presence of adults or 
offspring at a later date. In such cases, it is unknown 
how long a bird or nesting pair has been there. At 
the very best, population estimates of breeding birds 
based on simple counts should be seen as minimum 
population size estimates for each year. 

Comparison of Methods 

Over the period from 1983-91 in western Green¬ 
land, the same adult female peregrine falcons were 
identified on 125 occasions at 154 nest sites ( n ) in 


successive years. In this analysis, a nest site is in¬ 
cluded as many times as it was occupied in successive 
years, the unit of measure being one territory per 
year (Mearns and Newton 1984). Turnover was 
estimated (Seegar et al. unpubl. data) to be 

f>, = 18.8% (29/154). 

Adjusting the previous turnover estimate for five 
known movements, the estimated maximum mor¬ 
tality then was 

rn max = 15.6% (24/154), 

resulting in, 

= 84.41% minimum survival, 

with the standard error (SE) of the proportion 

SE = (06.(1 - A))A) 1/2 = 0-0292. 

Jolly-Seber analysis uses the individual histories of 
all captured (marked) birds, including those that 
were not replaced when they vacated their nest site, 
thereby using all of the available information for 
survival estimation. Using program JOLLY (Pol¬ 
lock et al. 1990), the chi-square goodness-of-fit tests 
selected the model with constant survival and con¬ 
stant capture probability over the entire study as the 
best fitting model. Calculated in this way, the esti¬ 
mate of survival is 

<f>i = 78.80% (SE = 0.0308), 

indicating higher mortality than the “maximum” 
mortality estimate from simple counts. Capture 
probability was estimated to be 0.9361 (SE = 0.0246). 
In the same spirit as the simple count estimate, the 
survival estimate from the Jolly-Seber model should 
be viewed as a minimum survival rate, because the 
effects of emigration cannot be separated from the 
estimate. Jolly-Seber survival estimates are less bi¬ 
ased than their simple count equivalents because the 
Jolly-Seber model does not assume vacancies with¬ 
out replacement by another bird are due only to 
emigration and it uses all of the available infor¬ 
mation. Although formal simulation studies in which 
parameter values are known have not been per¬ 
formed, statements concerning the bias of particular 
estimation methods in relation to other methods are 
appropriate when based on an assessment of the 
assumptions underlying the methods. 

A common occurrence in field studies is that the 
sampling effort changes over time. Financial re¬ 
sources can vary, allowing for more or less area to 
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Figure 1. Population size estimates of adult female per¬ 
egrine falcons and the respective amount of area surveyed 
in western Greenland from 1983-91. 


be sampled, or the same area is sampled more or 
less intensively, personnel experience can vary, and 
weather can alter the survey effort (Grier 1977, Ful¬ 
ler and Mosher 1987). In the case of more effort, 
survival estimation using capture-recapture tech¬ 
niques is robust to changes because survival esti¬ 
mates are conditional upon time of first capture. The 
less desirable case is when survival must be based 
only on those animals found by a reduced level of 
effort. 



Figure 2. Population size estimates of adult female per¬ 
egrine falcons from simple counts and the Jolly-Seber 
model for an area surveyed with constant effort over at 
least 8 yr. 


Use of the Jolly-Seber model provides compara¬ 
tively good survival estimates and less biased pop¬ 
ulation size estimates than the simple count method. 
However, more difficulties arise when considering 
population size estimation. Changing the sampling 
effort over time causes population size estimates to 
be misleading. If the intensity with which sampling 
occurs or the amount of area sampled increases over 
time, then increases in counts do not necessarily re¬ 
flect population size increases (Franklin et al. 1990). 
Female peregrine falcon population size estimates 
from the Greenland study (Seegar et al. unpubl. 
data) are given in Fig. 1. Population size estimates 
were computed using the capture histories of all 
female peregrines marked over the study period 
(1983-91). Some females were seen but never cap¬ 
tured and thus did not have a recorded capture his¬ 
tory. The number of females seen each year, but 
which remained unmarked, was added to the pop¬ 
ulation size estimates from the Jolly-Seber analysis 
(after adjusting for the estimated capture probabil¬ 
ity) to more accurately reflect population levels for 
a given year. Trend analysis using Lehmann’s test 
(Lehmann 1975) resulted in a significant positive 
trend (P < 0.0002). However, the amount of area 
sampled (Fig. 1) also had a similar positive trend 
(P < 0.0002). Based only on this information, one 
cannot conclude the number of female peregrines 
increased. 

Areas must be defined that are sampled equally 
every year; i.e., a constant-size area sampled with 
equal intensity, before a proper trend analysis of 
population size can be executed (Bromley 1988). In 
the Greenland study, an area in which nests were 
surveyed consistently for at least 8 yr was deter¬ 
mined. Population estimates (Fig. 2) for this area 
again showed a significant upward trend (P = 
0.0331). Although in this case the results agree with 
those calculated with unequal effort, in some in¬ 
stances the resulting tests based on constant sampling 
area might lead to different conclusions than those 
based on unequal area samples. It is important to 
keep the sampled area sizes constant, or at the very 
least, to carefully document the amount of area sam¬ 
pled and the intensity with which it is sampled to 
allow for density estimation and subsequent trend 
analysis. 

Unlike the Jolly-Seber survival estimates, un¬ 
equal capture probabilities for marked and un¬ 
marked birds (resulting from nest site surveys of 
birds with high nest-site fidelity) can lead to serious 
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Figure 3. Population size estimates of adult female per¬ 
egrine falcons from simple counts and the Jolly-Seber 
model assuming an estimated capture probability, p = 
0.75, for an area surveyed with constant effort over at least 
8 yr. 



Figure 4. Population size estimates of adult female per¬ 
egrine falcons from simple counts and the Jolly-Seber 
model assuming estimated capture probabilities increase 
steadily from p = 0.60 to j 6 = 0.95 for an area surveyed 
with constant effort for at least 8 yr. 


positive bias in the estimated capture probabilities, 
resulting in a negative bias in the estimated popu¬ 
lation sizes from the Jolly-Seber model. Under this 
sampling regime, birds nesting at unknown or un¬ 
surveyed sites within the sampling area can have 
capture probabilities as small as zero. For the Green¬ 
land study area in which nests were consistently 
surveyed for at least 8 yr, the reduced-parameter 
model estimated a constant capture probability of 
0.9541 (SE = 0.0254). Although heterogeneity has 
inflated the capture probability estimate, the bias 
from simple counts will always be greater than or 
equal to that associated with the Jolly-Seber estimate 
because simple counts assume capture probabilities 
to be one. In addition, the full parameter Jolly-Seber 
model (if selected) allows for variable capture prob¬ 
abilities, which may result from variable weather 
conditions, personnel experience, etc. 

Population size estimates of female peregrines in 
the Greenland study from the Jolly-Seber model and 
simple counts (Seegar et al. unpubl. data) are given 
in Fig. 2. The relatively small differences in this 
case will become more pronounced in other situa¬ 
tions with simple counts exhibiting even greater bias 
where capture probabilities are lower. Figure 3 com¬ 
pares the expected Jolly-Seber population size es¬ 
timates for the area sampled at least 8 yr to simple 


count estimates when the probability of capture is 
estimated to be 0.75. 

In the above case a constant capture probability 
was assumed. By allowing for variable capture prob¬ 
abilities over time, use of the Jolly-Seber model to 
estimate population size can lead to differences in 
the interpretation of trends as compared to the simple 
count method that assumes a constant capture prob¬ 
ability of one. Suppose, for example, capture prob¬ 
abilities were estimated to have constantly increased 
in the Greenland study from 0.60-0.95; i.e., the re¬ 
search group became more skilled in locating per¬ 
egrines as the study progressed. The differences in 
population size estimates under this scenario are 
illustrated in Fig. 4. As before, the Jolly-Seber model 
estimates a greater number of peregrines, but the 
allowance of variable capture probabilities by the 
Jolly-Seber model can also change the interpretation 
of population trends. 

Jolly-Seber population size estimates can be more 
biased than simple counts in the event individuals 
temporarily emigrate from the population. Under 
such circumstances, the Jolly-Seber model assumes 
the individuals remained in the population unde¬ 
tected, thus lowering the capture probability esti¬ 
mate and inflating the population size estimate. Grier 
(1977) noted that lack of detection of an individual 
found in later surveys is more likely attributed to 
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missing an individual that was present in the pop¬ 
ulation rather than the individual having temporar¬ 
ily emigrated. Even studies in which the same entire 
area was thoroughly surveyed, checking all potential 
nest sites (Mearns and Newton 1984), the research¬ 
ers acknowledged the possibility of having capture 
probabilities less than one (R. Mearns pers. comm.). 
For this reason, we suggest that Jolly-Seber popu¬ 
lation size estimates are more likely to be less biased 
than simple counts and should be used and regarded 
as minimums for their respective areas. 

Discussion 

Simple count estimates of population size and sur¬ 
vival rates require different study designs. When 
population estimation is the sole purpose of a study, 
the simple count method does not require birds to 
be marked; however, it is necessary for the size of 
the area sampled, the effort, and bird detectabilities 
to remain constant to enable the determination of 
trends over time. Once an area has been defined by 
a particular set of nests, it is essential that those nests 
be surveyed thoroughly every year, and, if possible, 
the entire area should be surveyed. Because simple 
counts assume capture probabilities of one, popu¬ 
lation size estimates will be negatively biased unless 
this assumption is valid. Because detectability usu¬ 
ally is not one and may vary over the study period, 
we suggest that capture-recapture techniques be used 
when possible, and a Jolly-Seber type of analysis be 
applied. 

Certainly, studies in which birds are marked re¬ 
quire considerably more effort than studies that do 
not. However, it is necessary to mark birds when 
survival estimates are desired. Where survival esti¬ 
mates require the marking of birds in the population, 
the size of the sampling area need not be constant. 
Effort should be directed toward marking and re¬ 
leasing as many birds as possible, and toward re¬ 
sighting the birds in the future. When individuals 
are present, they must be identified by band or not, 
and if unbanded, should be captured when possible 
and banded. 

Studies in which survival estimates and popula¬ 
tion size are of interest require both marking of birds 
and constant sampling effort. The presence of marked 
birds in the population allows for stronger, more 
sophisticated analyses than simple counts. Capture- 
recapture techniques lend themselves to the Jolly- 
Seber model as an appropriate tool for better esti¬ 
mating the important parameters of survival and 


population size. The Jolly-Seber model allows for 
less biased estimates of minimum survival and min¬ 
imum population size than the respective estimates 
from simple counts whether the purpose is survival 
estimation, population estimation, or both. The 
availability of such Jolly-Seber-based computer pro¬ 
grams as JOLLY and POPAN-3 facilitate the use 
of capture-recapture analysis to provide the best esti¬ 
mates based on all the data gathered. 
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